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Abstract — In this paper we study the effect of rate-limited feed- 
back on the sum-rate capacity of the deterministic interference 
channel. We characterize the sum-rate capacity of this channel 
in the symmetric case and show that having feedback links can 
increase the sum-rate capacity by at most the rate of the available 
feedback. Our proof includes a novel upper-bound on the sum- 
rate capacity and a set of new achievability strategies. 

I. Introduction 

In many communication scenarios there are feedback links 
available from the receivers back to the transmitters. It is well- 
known that feedback does not increase the capacity of discrete- 
memoryless point-to-point channels |[T). However, feedback 
can enlarge the capacity region of multi-user networks, even 
in the two-user memoryless multiple-access channel |[2j, 
Hence, there has been a growing interest in developing feed- 
back strategies and finding upper bounds on the capacity 
region of networks with feedback, in particular the two-user 
interference channel (for example see |j4|-||8|). Recently in ||9j, 
authors have approximated the capacity region of the two-user 
Gaussian interference channel with feedback and have shown 
that, quite interestingly, feedback can provide an unbounded 
gain (as signal-to-noise ratios increase). 

Most prior work on interference channel focus on the 
extreme case in which the feedback link has infinite capacity. 
However, a more realistic model is one where we have 
rate-limited feedback from the receivers to the transmitters. 
Throughout this paper, we will study such a network. As 
a stepping stone, we focus on the linear deterministic fTO'l 
interference channel with rate-limited feedback. The simple 
linear deterministic model captures the key properties of the 
Gaussian channel and often provides insights that can lead to 



approximating the capacity of Gaussian networks 1 11 |-|[T3[. 

The main contribution of the paper is the characterization 
of the sum-rate capacity of the symmetric deterministic in- 
terference channel with rate-limited feedback. The sum-rate 
capacity derived in our work, clearly depicts how we approach 
the sum-rate capacity of a network with infinte feedback from 
the sum-rate capacity of a network without any feedback. 
Moreover, as we will see throughout the paper, there is always 
a specific value of feedback which will be similar to the case 
where we have infinite feedback. 

Our proof includes a novel upper-bound on the sum-rate 
capacity and a set of transmission strategies to achieve it. We 
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Fig. 1 . Two-user interference cliannel with rate-limited feedback. 



basically show that the sum-rate capacity cannot be increased 
by more than the rate of the available feedback. A key property 
that we have used to prove this result is the linearity of the 
channel. Hence, an interesting open question for future work 
is: "Is it in general, i.e. without the linearity of the channel, true 
that the sum-rate capacity of the interference channel can at 
most be increased by the amount of the available feedback?". 

The rest of the paper is organized as follows, in Section 
[n] we describe our problem formulation and give our main 
result. Then, in Section III we propose the capacity achieving 



schemes. In Section IV we prove the converse. Section [V] 
depicts the sum-rate capacity for the limited feedback case as 
well as the infinite and the non-feedback cases. Section [Vl] 
concludes the paper 

II. Problem Setup and the Main Result 

In this section, we describe the problem formulation and 
state our main result. We consider the two-user interference 
network depicted in Figure 1. In this network transmitters 
1 and 2, want to communicate with receivers 1 and 2, re- 
spectively. We use the deterministic channel model introduced 
in (To) to model the channels between the tansmitters and 
the receivers. In this model, there is a non-negative integer 
associated with each channel which represents its gain. As 
shown in Figure 1, we consider the symmetric case in which 
the direct links between the transmitters and the receivers have 
equal gains (denoted by n) and the interfering links have also 
equal gains (denoted by to). 

In the deterministic interference channel, we can write 
the channel input to the transmitter i at time k as — 
[Xi\Xil . ..Xi^^Y, i = 1,2, such that Xi\ and respec- 
tively represent the most and the least significant bits of the 
transmit signal. Also q is the maximum of the channel gains in 
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the network, i.e. q — max{n, ni). At each time k, the received 
signal at receiver i (i = 1, 2) in our Unear model, denoted by 
Y^^, is given by 



k=2 k= 1 



(1) 



[ 2 — ^ ^1 

where 5 is the q x q shift matrix. 

We also assume that there is a noiseless rate-limited, with 
rate Rf, feedback from each receiver to the corresponding 
transmitter Here transmitter 1 and transmitter 2 wish to 
communicate reliably messages Wi e {1, 2, . . . , 2^^^} and 
W2 G {1,2,..., 2^^^} with receivers 1 and 2, respectively, 
by K uses of the channels. We say that a rate pair (i?i, i?2) is 
achievable, if there exists a block encoder at each transmitter 
(that can causally use the feedback) and a block decoder at 
each receiver, such that the error probability of decoding the 
desired message at each receiver goes to zero as the block 
length K goes to infinity. The maximum sum-rate, i.e. R1+R2, 
of all achievable rate pairs is called the sum-rate capacity. The 
following Theorem is our main result 

Theorem 2.1: The normalized sum-rate capacity of a de- 
terministic interference channel with rate-limited feedback is 
given by 
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a) for a e [0, 0.5] 

for a e [0.5, |] 

for a e [|, 1] 

for a G [1,2 + 2/3] 

for a e [2 + 2/3, 00] 
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where /3 is the normalized feedback rate, i.e /3 ~ 
is the ratio of the gain of the indirect link to that of the direct 
link, i.e. a — —. 

If we compare equation (2) to the sum-rate capacity without 
feedback y4J, |^15J 
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for a e [0, 0.5] 

for a e [0.5, |] 

for a e [|, 1] 

for a e [1,2] 

for a e [2, 00] 



(3) 



and the sum-rate capacity with infinite feedback |j9) 
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2-a for a e [0, 1] 
a for a G [1, 00] 
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we note that 

• Case 1 (a e [0, \]): In this regime the sum-rate capacity 
is increased by the total amount of feedback rates and 
saturates at 2 — a once the rate of each feedback link is 
larger than ^. 

• Case 2 (a € |]): In this regime the sum-rate capacity 
is increased by the total amount of feedback rates and 
saturates at 2a once the rate of each feedback link is 
larger than — ^ — -. 

• Case 3 (a € [|,2 + 2/3]): In this regime feedback does 
not increase the capacity. 
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Fig. 2. Scheme to achieve the capacity when q is equal to ^. 



• Case 4 (a G [2 + 2fi, oo\)\ In this regime the sum- 
rate capacity is always increased by the total amount of 
feedback rates. 

III. Transmission Strategies 

In this section we will provide the transmission strategies 
to achieve the capacity in Theorem 2.1. 

• Case 1 (a G [0, \]) 

We first start with the example shown in Figure 2. In this 
example, n = 2 and m — 1 and Rf — 1. We show that 
each transmitter can send 3 bits to its destination in two time 
slots and hence achieve a normalized sum-rate of 2 — a |. 
In the first time slot, each transmitter transmits two new data 
bits. Since the channel is symmetric, we will discuss only one 
of the receivers. Receiver one gets ai without any trouble. It 
also receives a2©6i. Now through feedback link, receiver one 
sends 02 ffi &i to transmitter one. In the second time slot each 
transmitter can decode the MSB from the other transmitter 
through the feedback and it will transmit it as the MSB in the 
next time slot, and it will also transmit a new bit on the LSB. 

For example, transmitter one transmits hi as the MSB in 
second time slot. Now, receiver one has ai, hi, 02 ® 61, and 
Oi ® 03. Hence, it can decode all ai, 02 and 03. Receiver 2 
can also decode hi, 62 and 63. Therefore, we have reached the 
sum-rate of 6 bits in two time slots, or equally, 3 bits per time 
slot. Here, we can see that this result is the same as the infinite 
feedback case. As we will see throughout the paper, we can 
always find a value of feedback rate that will behave as the 
infinite feedback case, and as a result having higher feedback 
capacity than this value cannot help. 

This result is what we have proposed in Theorem 2.1. There 
we mentioned that the capacity when a is less than or equal 
to i is min(2 — 2a + 2/3, 2 — a). In the above example, a is 
equal to ^ and /3 is also equal to Therefore, from Theorem 
2.1, we have the capacity 2 x (2 — a) = 3 for this example. 

Now that we have seen the strategy through a simple 
example, we will give a scheme for the general case where 
a<\. 

As shown in Figure 3, in the first time slot, i.e. k = 1, 
each transmitter i sends n — m bits, such that it does not 
cause interference at the receivers. We also send Rf new 
bits using the top signal levels, i.e. Aji where the first index 
indicates the transmitter and the second index indicates the 
time slot. These bits will interfere at the receivers. Since the 



Fig. 3. Transmission strategy for Case 1 (a < |). 



Fig. 5. Transmission strategy for Case 4 (a > 2 + 2/3). 



k = 3 k = 2 k = lT>:i Rx, ^ = 1 k = 2 




Fig. 4. Transmission strategy for Case 2 (o S [|, |]). 

number of interfered levels are i?/, receivers will send them 
back to the transmitters, and each transmitter can remove its 
own bits and decode the interfering signals. In the second 
time slot, we repeat the same scheme. However, we also send 
the Rf interfering bits which has been recovered from the 
interfered signal, i.e. An and A21. With this scheme, each 
receiver will use these bits to remove the interference in the 
first time slot. Moreover, the interference that these bits create 
is not important, because the receivers already know them and 
can cancel them out. The same scheme can be done for the 
coming time slots. Through this transmission strategy we have 
achieved the rate n — m + Rf at each transmitter per time slot, 
which is the same as what we have proposed in Theorem 2.1. 
• Case 2 (a e [5, §]) 

In this case, each transmitter i transmits 2m — n bits starting 
from the MSB and n—m bits on less significant bits, in the first 
time slot, as shown in Figure 4. Each transmitter also transmits 
Rf bits as depicted, i.e. An and A21. Consider receiver 
1, it receives m bits from transmitter 1 and Rf bits from 
transmitter 2. Now, it will send the Rf bits from transmitter 
2 to transmitter 1 through the feedback link. In the second 



time slot, we use the same strategy as in the first time slot 
and we also need to send Rf bits received by transmitter 1 
through feedback link, i.e. A21. To avoid interference at the 
receiver, we should have Rf less than or equal to (^"~-^™) ^ 
However, looking at the capacity of the infinite feedback case 
in Q, we can easily conclude that this is exactly the amount of 
feedback which will result in a behavior similar to the infinite 
feedback case. We do exactly the same scheme for the coming 
time slots. With this scheme we have achieved the normalized 
sum-rate 2 a + 2/3. 

• Case 3 (a e [|,2]) 

As we noted just after Theorem 2.1, for a between | and 2, 
the capacity cannot be increased with feedback, therefore we 
can simply use the scheme proposed in |12j for this interval. 

• Case 4 (a greater than 2) 

First assume that a is greater than 2 + 2/3, we use the 
following method: in the first time slot, each transmitter sends 
n + Rf new data bits. Receiver 1, receives n bits from 
transmitter 1 and n + Rf bits from transmitter two. Receiver 

1 uses the feedback link to send the Rf bits from transmitter 
2, i.e. the bits that receiver 2 does not have access to in the 
first time slot (A21), to transmitter 1. In the second time slot, 
tramitter 1 repeats this scheme and also sends the Rf bits that 
it has received through feedback. We use exacatly the same 
strategy for transmitter and receiver 2. In the following time 
slots, we repeat the same scheme as in the second time slot. 
The method is depicted in Figure 5. At the receivers, we have 
only depicted the bits that will be sent back to the transmitters 
through feedback. With this scheme we achieve the sum-rate 

2 + 2/3, which is the same sum-rate suggested in Theorem 2.1. 
Now with the scheme just described, it can be easily seen that 
when a is smaller than 2 + 2/3 and grater than 2, the sum-rate 
capacity is equal to the case where we have infinite feedback. 

IV. Converse 

• Case 1 (a < i) 

In order to prove the converse in this case, we first prove the 
following lemma, which upper bounds H{P^ , V^\V^ , Q^) 
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Cut-set bound = n + Rf 




(a) Case 1 (b) Case 2 

Fig. 6. 



and H{Pi^, V^\Vi^ , ). Here, and V^^ are received by 
both receivers. Pi and will be interfered with and 
at the receivers, respectively. and Q2 are received 
by only one receiver without any interference, see Figure 6(a). 

Lemma 4.1: For the linear network described above we 
have 



Qf ) < anK + 1 + Kp^ 



H{P^, Vi'\Vi', Of) <ocnK + l + Kp, 



K 



(5) 



where p^ is the decoding error probability. 

Proof: Given Y/^ , receiver i should be able to decode 
X-^ (with high probabiUty as K ^ 00), i = 1,2. Therefore, 
by using the Fano's inequality we have 



H{Pi^, V^^\Y^) = H{Pf\Yi^) + H{Vi'\Y^, ) 

(Fano) 

= H{P^\Yi^) < 1 + 
H{P^, Vi^\Yi') = H{P^\Yi') + H{Vi^\Yi', Pf ) 



(6) 



(Fano) 

= H{P^\Yi^) < 1 + Kp^ 

Note that //(Fa^iy/^, Pf ) = //"(Fi^lFa^, Ps^) = 0, due to 
the Unearity of the channel. Next, we can write 



if (pf , y^^ii^i^, of, pf © y^"") < 1 + ^pf 
if (pf , Vi^iy/^, of , Ps"" e y/") < i + i^pf 



(7) 



since the terms Pf © and Pj^ © V^^ have at most anii' 
bits each, therefore we have 



H{Pi^,Vf\Vi'', 



f ) < anK +l + Kp, 



K 



K 



H{P^, V^lVi", Of) <anK+l + Kp, 

We will also need the next lemma in our proof. 
Lemma 4.2: /(Xf ;Xf ) < 2KRf 

Proof: 
We can write 

7(Xf ;Xf ) < I{Wi,Fi^;W2,Fi') 

= I{Wi;W2) + I{Wi;Fi'\W2) 

+ HFf; W2\Wi) + I{F^; F^\Wi, W^) 

< 2KRf 



(8) 



(9) 



Fig. 7. Cut-set bound when a > 2. 



We know that Wi is independent of W2, therefore: 
I{Wi;W2) = 0. Moreover given Wi and W2, we can 
construct everything, as a result I{Ff^; F.^\Wi,W2) = 0. 
Now since Pf and F^ are at most KRf bits each, the proof 
is complete. ■ 
Before proceeding to the proof, we have to note the follow- 
ing inequaUty which will be used later 

H{Wi,W2) 

= I{Wi, W2; Y^, Yf) + H{Wi,W2\Yi'', Yf) 

< /(Xf , Xf ; y,^, Y,^) + H{W„W2\Yf, Y,^) ^^^^ 



(b) 



K 



< H{X^,X^) + 2 + 2Kp^^ 

where (a) follows from data processing and (b) from Fano. 
We are now ready to prove the converse in this case 



K{Ri+R2) = H{Wi,W2 
< i?(Xf ) + iJ(Xf |X 



K 



H{Q^\Vi')+H{P^\Q^,V2^) 



+ H{Vi^\Vi', Of, P^) + H{Q'^\Vi^, , Of, P^) 
+ (Pf ¥2"", Of, Qf , P2) + 2 + 2Kp^ 
< H{V2^\Vf, Of) + H{P^\Vi^, y/, Of) 



H{P^\V2^. Of) + H{Vf\Vi', P« , O2 



K 



= i?(Pf,l/2^|n^,0f 



7f (Of ) + I{V2^ ; Fi" , Of ) + 2 + 2Kp, 
i/(Pf,yi^|y2^,0f) 
+ 1(^2^; n^, Of) + i?(Of ) + (Of ) + 2 + 2ii:^,f 
< 2Kn - 2aKn + 2KRf +4 + AKpf 



(11) 



where the last step is true, since 

1) By Lemma 4.1, H{P^ 
H{P2, V^\Vi^, Of) < 2anif + 2 + 2Kp^ . 

2) By Lemma 4.2, 7(^2^; V^^, Of ) < /(Xf;Xf ) < 
2i^P/. 

3) (Of ) + -ff (Of ) < 2is:n - 4ais:n, as each is at most 
(1 - 2a)Kn bits. 

The converse can be obtained by dividing both sides by K 
and letting K ^ 00. 

• Case 2 (a e [0.5,2/3]) 

This case is depicted in Figure 6(b). Similar to the previous 
case, we can write 
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K{Ri+R2) = H{WuW2) 

< H{X^) + |Xf ) + 2 + 2Kp^ 

= H{Vf) + H{P!^\Vi') + ff(T^i^|Vf ,Pf ) 
+ H{P^\V,^, V^^, Pf) + 2 + 2Xpf 

< ff(V^2^ln^) + H{P,^\V,^,Vj') 
+ H{P^\Vi') + H{V^^\V2'',P^) 
+ /(F2^;Fi^) + 2 + 2ii:pf 

+ /(T/2^;T/i^) + 2 + 2i<rpf 

< 2aKn + 2ii:P/ + 4 + 4is:pf 

where the last step is true, since 

1) Similar to Lemma 4.1, we can show that 

H{P^,V,^\Vi')<anK + l + Kpf 

2) By Lemma 4.2, I{V^] V^) < I{X{^;X^) < 2KRf. 
The converse can be obtained by dividing both sides by K 
and letting K oo. 

• Case 3 (a e [|,2]) 

For this interval feedback does not increase the capacity and 
as a result we can use the proof in |[9) or p2j . 

• Case 4 (a > 2) 

In this case we prove the converse by using a cut-set bound, 
similar to the one used in |^. The linear network is shown in 
Figure 7, consider the cut (dashed line) which separates each 
transmitter from its receiver (note that we have interchanged 
the place of one of the transmitter-receiver pairs in this figure). 
Since the sum of the capacities of the links going from each 
side of the cut to the other side is equal to n + Rf, the 
sum-rate capacity is upper-bounded by 2n + 2Rf. As a result 
the normalized sum-rate is upper bounded by 2 + 2/3. This 
completes the proof of Theorem 2.1. 

V. Plots 

In Figure 8, we have plotted the sum-rate capacity of 
the deterministic interference channel for P/ = 0.125 x n, 
as well as the extreme cases, i.e. infinite feedback and no 
feedback cases. As Rf increases the curve approaches the 
infinite feedback case. Another case that can be considered, is 
where we have variable feedback. However, we just considered 
the case where P/ is constant. We should pay attention that 
we are focusing on the sum-rate and therefore our curve starts 
at 2 for a = 0. 

VI. Conclusion 

We studied the deterministic interference channel with rate- 
limited feedback. We fully characterized the sum-rate capacity 
of the symmetric deterministic interference channel with rate- 
limited feedback. We developed a new outer bound which 
shows that the sum-rate capacity cannot be increased by more 
than the total rate of available feedback. Our proof of the 
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Fig. 8. Proposed capacity as well as infinite feedback and non feedback 
scenarios. 

converse relies on the linearity of the channel. An interesting 
open problem is to understand whether the same is true in 
general {i.e. when the channels are not necessarily linear). 
The next step is to generalize our converse and achievability 
strategies to the Gaussian networks. 
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